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WO 00/20885 1 PCT/EP99/07474 

Ultrasonic diagnostic imaging system with blurring-corrected spatial compounding. 



This application claims the benefit of Provisional U.S. Patent Application serial 
number 60/102,923, filed October 1, 1998. This application is being concurrently filed with 
U.S. Application serial number [ATL-196], entitled "Method for correcting blurring of 
spatially compounded ultrasonic diagnostic images." 

5 This invention relates to ultrasonic diagnostic imaging systems and, in 

particular, to ultrasonic diagnostic imaging systems which produce spatially compounded 
images which are corrected for image blurring. 

Spatial compounding is an imaging technique in which a number of ultrasound 
images of a given target that have been obtained from multiple vantage points or angles are 

10 combined into a single compounded image by combining the data received from each point in 
the compound image target which has been received from each angle. Examples of spatial 
compounding may be found in US Patents 4649927; 4319489; and 4159462. Real time spatial 
compound imaging is performed by rapidly acquiring a series of partially overlapping 
component image frames from substantially independent spatial directions, utilizing an array 

15 transducer to implement electronic beam steering and/or electronic translation of the 
component frames. The component frames are combined into a compound image by 
summation, averaging, peak detection, or other combinational means. The acquisition 
sequence and formation of compound images are repeated continuously at a rate limited by the 
acquisition frame rate, that is, the time required to acquire the full complement of scanlines 

20 over the selected width and depth of imaging. 

The compounded image typically shows lower speckle and better specular 
reflector delineation than conventional ultrasound images from a single viewpoint. Speckle is 
reduced (i.e. speckle signal to noise ratio is improved) by the square root of N in a compound 
image with N component frames, provided that the component frames used to create the 

25 compound image are substantially independent and are averaged. Several criteria can be used 
to determine the degree of independence of the component frames (see, e.g., O'Donnell et al. 
in IEEE Trans. UFFC v.35, no.4, pp 470-76 (1988 } ). In practice, for spatial compound imaging 
with a steered linear array, this implies a minimum steering angle between component frames. 
This minimum angle is typically on the order of several degrees. 
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The second way that spatial compound scanning improves image quality is by 
improving the acquisition of specular interfaces. For example, a curved bone-soft tissue 
interface produces a strong echo when the ultrasound beam is exactly perpendicular to the 
interface, and a very weak echo when the beam is only a few degrees off perpendicular. These 

5 interfaces are often curved, and with conventional scanning only a small portion of the 
interface is visible. Spatial compound scanning acquires views of the interface from many 
different angles, making the curved interface visible and continuous over a larger field of 
view. Greater angular diversity generally improves the continuity of specular targets. 
However, the angular diversity available is limited by the acceptance angle of the transducer 

10 array elements. The acceptance angle depends on the transducer array element pitch, 
frequency, and construction methods. 

The challenges of acquiring images which are in spatial alignment, or of 
spatially aligning separate images after they have been received, can be considerable. When 
the objective is to produce spatially compounded images in real time, an even greater 

15 challenge is presented. Image processing must be fast and efficient so that the frame rate of 
compound images appears to be in real time. The compound images can suffer from motion 
artifacts, as organs such as the heart and blood vessels can be continually moving as the image 
data to be compounded is acquired. 

One of the problems associated with real time spatial compound imaging is that 

20 several image acquisitions are needed to produce each new compound image frame. The time 
needed to acquire a spatial compound image consisting of N component frames is 
approximately N times longer than that of each individual component frame. It is generally 
desirable to acquire a large number of component frames to maximize the image quality of the 
compound image. However, since the images to be compounded are acquired temporally, the 

25 compounding of the images can produce a blurred resultant image. Image blurring occurs in 
real time spatial compound imaging because common features in the acquired component 
frames do not superimpose exactly when compounded. Misregistration between acquisition 
frames can occur for a number of reasons, such as: 

1. features can shift position within the image plane due to scanhead and/or patient 
30 movement during acquisition (in-plane motion misregistration). This kind of 

misregistration can be global (translation and/or rotation of entire image) or local (image 
distortion due to cardiac or respiratory motion, or compression of the tissue with the 
scanhead). 
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2. features can shift position due to an incorrect assumption regarding the speed of sound, 
causing the features to be rendered with axial and angular misregistration (SOS 
misregistration). This kind of misregistration can be due to an incorrect mean speed of 
sound or variations in local speed of sound within different tissue types. 

Accordingly, it is desirable to prevent blurring from causes such as these when 
compounding images for real time display. 

In accordance with the principles of the present invention, blurring of a 
compound image is reduced and image quality improved through correction of misregistration 
errors by registering the component frames to each other prior to compounding. This is 
possible by the application of image registration techniques. Image registration is meant here 
as a general term to describe any process which estimates global and/or local displacement 
information between two images, and warps one (or both) images to make them congruent 
with each other. A number of techniques may be used to estimate the displacement, including 
cross correlation search, block matching algorithms, maximum brightness, and feature 
extraction and tracking. Warping algorithms may be first order, global transformations 
(translation and/or rotation) or higher order (complex local warping), based on the nature and 
magnitude of the displacements. The component frames are registered to each other prior to 
compounding, improving image quality. 

In the drawings: 

Fig. 1 illustrates in block diagram form an ultrasonic diagnostic imaging system 
constructed in accordance with the principles of the present invention; 

Fig. 2 illustrates in block diagram form a preferred implementation of the 
spatial compounding processor of Fig. 1; 

Fig. 3 illustrates a flowchart for registering all of the constituent frames of a 
compound image to one reference frame; 

Fig. 4 illustrates a flowchart for pyramid registration of the constituent frames 
of a compound image; 

Fig 5 illustrates a flowchart for the successive registration and compounding of 
the constituent frames of a compound image; 

Fig. 6 illustrates a flowchart for pyramidal registration of non-sequential image 
frames to form a compound image; 
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Fig. 7 illustrates a flowchart for the successive registration and compounding of 
new component frames in conjunction with the removal of old component frames from the 
compound image; and 

Fig. 8 illustrates the use of reference lines for image registration. 
5 Referring first to Fig. 1, an ultrasonic diagnostic imaging system constructed in 

accordance with the principles of the present invention is shown. A scanhead 10 including an 
array transducer 12 transmits beams at different angles over an image field denoted by the 
dashed rectangle and parallelograms. Three groups of scanlines are indicated in the drawing, 
labeled A, B, and C with each group being steered at a different angle relative to the scanhead. 

10 The transmission of the beams is controlled by a transmitter 14 which controls the phasing and 
time of actuation of each of the elements of the array transducer so as to transmit each beam 
from a predetermined origin along the array and at a predetermined angle. The echoes returned 
from along each scanline are received by the elements of the array, digitized as by analog to 
digital conversion, and coupled to a digital beamformer 16. The digital beamformer delays and 

15 sums the echoes from the array elements to form a sequence of focused, coherent digital echo 
samples along each scanline. The transmitter 14 and beamformer 16 are operated under 
control of a system controller 18, which in turn is responsive to the settings of controls on a 
user interface 20 operated by the user of the ultrasound system. The system controller controls 
the transmitter to transmit the desired number of scanline groups at the desired angles, transmit 

20 energies and frequencies. The system controller also controls the digital beamformer to 

properly delay and combine the received echo signals for the apertures and image depths used. 

The scanline echo signals are filtered by a programmable digital filter 22, which 
defines the band of frequencies of interest. When imaging harmonic contrast agents or 
performing tissue harmonic imaging the passband of the filter 22 is set to pass harmonics of 

25 the transmit band. The filtered signals are then detected by a detector 24. In a preferred 

embodiment the filter and detector include multiple filters and detectors so that the received 
signals may be separated into multiple passbands, individually detected and recombined to 
reduce image speckle by frequency compounding. For B mode imaging the detector 24 will 
perform amplitude detection of the echo signal envelope. For Doppler imaging ensembles of 

30 echoes are assembled for each point in the image and are Doppler processed to estimate the 
Doppler shift or Doppler power intensity. 

In accordance with the principles of the present invention the digital echo 
signals are processed by spatial compounding in a processor 30. The digital echo signals are 
initially pre-processed by a preprocessor 32. The pre-processor 32 can preweight the signal 
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samples if desired with a weighting factor. The samples can be preweighted with a weighting 
factor that is a function of the number of component frames used to form a particular 
compound image. The pre-processor can also weight edge lines that are at the edge of one 
overlapping image so as to smooth the transitions where the number of samples or images 

5 which are compounded changes. The pre-processed signal samples may then undergo a 
resampling in a resampler 34. The resampler 34 can spatially realign the estimates of one 
component frame or to the pixels of the display space. This may be desirable when there is 
motion between image frames, there is motion within an image, or there is scanhead motion 
during image acquisition. 

10 After resampling the image frames are compounded by a combiner 36. 

Combining may comprise summation, averaging, peak detection, or other combinational 
means. The samples being combined may also be weighted prior to combining in this step of 
the process. Finally, post-processing is performed by a post-processor 38. The post-processor 
normalizes the combined values to a display range of values. Post-processing can be most 

15 easily implemented by look-up tables and can simultaneously perform compression and 
mapping of the range of compounded values to a range of values suitable for display of the 
compounded image. 

The compounding process may be performed in estimate data space or in 
display pixel space. In a preferred embodiment scan conversion is done following the 

20 compounding process by a scan converter 40. The compound images may be stored in a 

Cineloop® memory 42 in either estimate or display pixel form. If stored in estimate form the 
images may be scan converted when replayed from the Cineloop memory for display. The 
scan converter and Cineloop memory may also be used to render three dimensional 
presentations of the spatially compounded images as described in U.S. Patents 5,485,842 and 

25 5,860,924. Following scan conversion the spatially compounded images are processed for 
display by a video processor 44 and displayed on an image display 50. 

Fig. 2 illustrates a preferred implementation of the spatial compounding 
processor 30 of Fig. 1. The processor 30 is preferably implemented by one or more digital 
signal processors 60 which process the image data in various ways. The digital signal 

30 processors 60 can weight the received image data and can resample the image data to spatially 
align pixels from frame to frame, for instance. The digital signal processors 60 direct the 
processed image frames to a plurality of frame memories 62 which buffer the individual image 
frames. The number of image frames capable of being stored by the frame memories 62 is 
preferably at least equal to the maximum number of image frames to be compounded such as 
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sixteen frames. In accordance with the principles of the present invention, the digital signal 
processors are responsive to control parameters including image display depth, depth of region 
of greatest compounding, clinical application, compound display rate, mode of operation, and 
acquisition rate for determining the number of images to compound at a given instant in time. 
The digital signal processors select component frames stored in the frame memories 62 for 
assembly as a compound image in accumulator memory 64. The compounded image formed 
in the accumulator memory 64 is weighted or mapped by a normalization circuit 66, then 
compressed to the desired number of display bits and, if desired, remapped by a lookup table 
(LUT) 68. The fully processed compounded image is then transmitted to the scan converter for 
formatting and display. 

In accordance with the principles of the present invention, the image data of the 
component frames used to form a compound image is resampled to spatially register the 
component frames prior to compounding, thereby improving image quality by reducing 
blurring effects of overlapping unregistered image data. The resampling and registration of 
component image frames is performed by the programming of the digital signal processors 60, 
which operate upon component images stored in the frame memories 62. The final registered 
and compounded image is then stored in the accumulator memory 64. Prior art techniques 
have used image registration methods for estimating intrinsic tissue properties, such as speed 
of sound or elasticity, as diagnostic parameters (e.g., Robinson et. al. in Ult. in Med. & BioL 
v.17, no.6, pp 633-46 (1991) and Ophir et al. in Euro. J. Ult , v.3, pp 49-70 (1996)), or for 
estimating scanhead motion to produce a static "panoramic" image (e.g., U.S. Patent 
5,566,674). 

There are many possible implementations for image registration prior to 
compounding in accordance with the present invention. Fig. 3 illustrates one embodiment, the 
"reference frame" method, as applied to a four frame acquisition sequence. The four 
constituent frames for compounding are shown as A, B, C, and D in temporal sequence in Fig. 
3. One of the component frames (A) is designated as the "reference frame," and as subsequent 
frames (B,CJ3) are acquired, they are warped so that their features are congruent with 
corresponding features of frame A. As the flowchart shows, when frame B is acquired it is 
registered with frame A, then frame C is acquired and registered with frame A, then frame B is 
acquired and registered with frame A. After all four constituent frames have been acquired and 
registered, the aligned frames are compounded. The process is repeated with each new 
acquisition sequence (E,F,G,H with E designated as the new reference frame). Alternatively, 
the reference frame can be updated with each new acquisition frame (B, C, D, E with B as the 
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reference frame; C,D,E,F with C as the reference frame; etc.) Any one of the frames of each 
four frame sequence may de designated as the reference frame. 

Fig. 4 illustrates a second embodiment in which pairs of images are registered 
and compounded, followed by a second step of registration and compounding of the 
previously registered and compounded pairs, termed herein as the "pyramid" method. Fig. 4 
illustrates the pyramid technique for four component images A, B, C, and D. In the first step of 
the method the A and B frames are registered and compounded, then the C and D frames are 
registered and compounded. These intermediate compounded images, identified as U and V, 
are then registered and compounded to form the final compound image. 

If only partial correction of the misregistration error is acceptable (or if 
conditions exist where registration of all component frames may be unreliable), then the first 
registration step can be omitted, gaining a substantial reduction in computational requirements. 
In that case the temporally adjacent images A and B are compounded, as are temporally 
adjacent images C and D. The resulting two intermediate compounded images, U and V, are 
then registered and compounded. Another alternative is to register frames A and B and then 
frames C and D, compound the registered frame pairs, then omit the last registration step and 
simply compound the intermediate U and V images to form the final compound image. 

Fig. 7 illustrates a further aspect of the present invention which is that, while 
the A,C,B,D frame sequence in this drawing is temporally sequential, the temporally adjacent 
frames are not spatially adjacent. That is, the look direction of frame C is not the angularly 
similar look direction of frame B, but is at a significantly different look direction from that of 
frame A, the frame with which it is initially compounded. The same is true of the B and D 
frame pair. This will result in the best possible intermediate compounded images U and V, 
since the temporal adjacency will reduce motion artifacts while the more greatly divergent 
look directions will reduce the anisotropy in the compounded image. 

Fig. 5 shows yet another embodiment where the compound image is 
accumulated frame by frame with successive registration and compounding steps. In the 
illustrated embodiment images A and B are registered and compounded to form a first 
intermediate compound image B\ Image B' is then registered and compounded with image C 
to form a further intermediate compound image C\ Image C* is then registered and 
compounded with a further image D to form the final compound image. 

Fig. 6 illustrates yet another embodiment in which the registration transforms 
undergone by each component frame are tracked and stored, and used to completely remove 
the component frame when the compounded image is updated with a current component 
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frame. At the top of the drawing the transform U necessary to register the estimates of frame A 
to those of frame B is computed and used to perform the registration of frame A to frame B, 
thus producing a two-frame compounded image B+A u . Next, the transform V which registers 
the compounded image B+A u to frame C is computed and used to perform the registration, 
5 thereby producing a three-frame compounded image C+B v +A uv . Note that frame A has now 
been processed by transforms U and V. In this example a three-frame compounded image is 
the desired result, which means that as the next frame D is registered and combined with the 
compounded image, the initial frame A is removed from the combination. This involves two 
process steps. In one of the process steps, the transform W which registers the compounded 
10 image C+B^A 1 ™ to frame D is computed and used to perform the registration of the 

compounded image to frame D. In the other process step the transform UVW, representing the 
transforms previously experienced by frame A, are applied to frame A and subtracted from the 
compounded image. This removes all vestiges of frame A from the combination, since the 
transforms delineate the cuiTent locations of frame A data after all of the transformations 
15 undergone by the frame data. The frame A data is thus cleanly removed from the compounded 
image, leaving a new compounded image of the form D+C^BT In the next step another 
new three-component compounded image, E+D^C™* is produced which includes data from 
frames C, D, and E after removal of frame B data by operation of the transform VWX, which 
tracks the changes experienced by previous registrations of frame B. It is seen that each 
20 subtraction cleanly removes the oldest component frame data by virtue of the use of the 
complete transform undergone by the oldest frame, and that a new compounded image for 
display is produced with the addition of each new component frame. This registration 
technique can advantageously be implemented with a single compound image accumulator, as 
more fully described in U.S. Pat. [appl. SN ATL-198] entitled "Ultrasonic diagnostic imaging 
25 . system with real time spatial compounding processor". 

The above embodiments of the present invention for conducting registration 
prior to compounding perform substantially equivalently as long as all the component frames 
have a high degree of similarity. In practice, however, the component frames do not always 
display the desired high degree of correlation due to "spatial artifacts" produced by non- 
30 uniform, anisotropic, or scattering properties of tissue such as: 

1. highly attenuating tissues (e.g. fetal ribs, gall stones, certain types of tumors, etc.) can 
cause image artifacts called "acoustic shadows". These shadows are cast in a direction that 
depends on the angle of incidence of the ultrasound beam. A spatial compound image 
comprising component frames of different angles of incidence to the same target will 
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contain acoustic shadows in different locations, reducing the correlation between the 
component frames. The apparent decorrelation due to acoustic shadowing cannot be 
corrected by image registration methods, since registration of the shadows would cause 
misregistration of the real anatomy. 
5 2. anisotropic reflectors such as tendons, bony surfaces, and the walls of blood vessels reflect 
ultrasound in a specular, mirror-like manner, producing artifacts called "highlight echoes." 
Highlight echoes shift position depending on the angle of insonification, creating 
decorrelation and/or apparent misregistration between component frames. Although it is 
generally desirable to acquire spatially diverse views of such specular targets so that they 
10 appear more continuous in the compound image, the resulting decorrelation and/or 

misregistration due to highlight artifacts can confound image registration methods and 
produce inaccurate registration results. 
3. unresolved scatterers within tissue often produce a "texture pattern" superimposed on the 
ultrasound image. Although some of this pattern may be due to underlying regular or semi- 
15 regular microstructure, much of it is an undesirable, random mottling of the image known 
as "speckle." When the same tissue is imaged from independent spatial directions, the 
random speckle patterns are also independent, creating decorrelation from frame to frame 
that can contribute to inaccurate registration results. 

In the presence of these spatial artifacts, the methods for registration prior to 
20 compounding do not all perform equivalently. For example, the reference frame method 
shown in Fig. 3 may fail to perform reliably if the component frames are acquired from 
. substantially different directions. The resulting artifacts from shadowing or specular reflectors 
may prevent accurate registration prior to compounding. In this case, the pyramid method 
shown in Fig. 4 may perform better by registering spatially adjacent frames (with higher 
25 correlation) prior to compounding, followed by registration of the intermediate compound 
images. Fortunately, spatial compounding tends to improve the quality of the intermediate 
compound image by both filling-in specular reflectors more completely and reducing speckle. 
This potentially improves the quality of registration of the intermediate compound images 
prior to combining them into a final registered, compound image. 
30 Another significant source of frame to frame decorrelation is due to motion of 

the scanhead in the direction perpendicular to the image plane (elevation motion 
decorrelation). When the clinical operator is searching for abnormalities (i.e. in a "survey 
mode") the probe is typically moved fairly rapidly in the elevation direction in order to view 
as much tissue as possible as quickly as possible. The result of elevation motion decorrelation 
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is that temporally sequential component frames become increasingly decorrelated as structures 
move out of the scan plan and their corresponding image features disappear. Again, the 
reference frame method shown in Fig. 3 may fail to perform reliably because elevation motion 
decorrelation over the entire acquisition sequence may prevent accurate registration prior to 
5 compounding. The pyramid method shown in Fig. 4 may perform better by registering 
temporally adjacent frames (with higher correlation) prior to compounding, followed by 
registration of the intermediate compound images. 

A preferred technique for sensing misregistration, shown in Fig. 8, is to acquire 
a small number of "calibration" lines interspersed between each component frame. The ROI 

10 defined by these calibration lines is preferably viewed from a constant look direction and is 
used for misregistration sensing using SAD or other algorithms. As Fig. 8 shows, the 
calibration or reference lines acquired between component frames are used to compute SAD or 
otherwise to measure the degree of misregistration that has occurred during the time required 
to acquire a component frame. The calibration lines need not be at a regular line density or 

15 uniform angularity, but may be widely spaced and/or scattered across the image plane, and 
may be differently angled. A sparsely sampled frame will perform admirably. Although the 
additional lines will lower the overall frame rate, the temporal degradation need not be very 
great due to the low number of reference lines and, in any case, an adaptive approach can still 
give the user the sense of a satisfactorily high frame rate. 
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CLAIMS: 



1. An ultrasonic diagnostic imaging system, including an array transducer which 
is operated to acquire images at a plurality of different look directions, comprising: 

- a resampler which spatially registers component images of a compound image prior to 
compounding; and 

5 - a compound image processor, responsive to said resampler, which compounds images of 
different look directions to form a spatially compounded image. 

2. The ultrasonic diagnostic imaging system of Claim 1, wherein said resampler 
comprises means for spatially registering a component image with a compound image of 

10 registered component images. 

3. The ultrasonic diagnostic imaging system of Claim 2, wherein said compound 
image processor comprises means for combining a component image with a compound image 
with which said component image has been spatially registered. 

15 

4. The ultrasonic diagnostic imaging system of Claim 1, wherein said resampler 
and said compound image processor comprise means for registering and compounding 
component images in the sequence in which they are acquired. 

20 5. The ultrasonic diagnostic imaging system of Claim 1, wherein said resampler 

comprises means for registering component images which are not spatially adjacent. 

6. The ultrasonic diagnostic imaging system of Claim 1, wherein said resampler 

comprises means for registering sequentially acquired component images; and wherein said 
25 compound image processor comprises means for compounding sequentially acquired and 
registered component images. 
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7. The ultrasonic diagnostic imaging system of Claim 1, wherein one of said 

component images comprises a reference image and wherein said resampler comprises means 
for registering other component images with said reference image. 

5 8. The ultrasonic diagnostic imaging system of Claim 1, wherein said resampler 

and said compound image processor comprise: 

- means for registering and combining component images to form intermediate compounded 
images; and 

- means for combining intermediate compounded images. 

10 

9. The ultrasonic diagnostic imaging system of Claim 8 wherein said resampler 

and said compound image processor further comprise: 

- means for registering and combining intermediate compounded images, 

15 10. The ultrasonic diagnostic imaging system of Claim 8, wherein said resampler 

and said compound image processor further comprise: 

- means for registering and combining pairs of component images which are not temporally 
adjacent to form intermediate compounded images. 

20 11. The ultrasonic diagnostic imaging system of Claim 1, wherein said resampler 

comprises a processor which calculates a metric representing the similarity or difference 
between component image frames. 

12. The ultrasonic diagnostic imaging system of Claim 1, wherein said resampler 
25 comprises means for registering component images which are spatially adjacent. 

13. The ultrasonic diagnostic imaging system of Claim 1, further comprising means 
for acquiring reference image data on a time interleaved basis with said component images; 
and 

30 - wherein said resampler spatially registers component images on the basis of said reference 
image data. 
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14. The ultrasonic diagnostic imaging system of Claim 13, wherein said reference 
image data comprises groups of reference lines acquired between the times of acquisition of 
component images. 

15. The ultrasonic diagnostic imaging system of Claim 14, wherein said reference 
lines exhibit a corresponding spatial alignment. 



WO 00/20885 



PCT/EP99/07474 



2/8 



fig I 

cog 



CO 
CO * 



ID 

-J 




CM 
CO 



SP 
c5 

s 



^5 



CM 

CD 



m <u w 
sb c: <o 

a. 



t 



DC 
o 



Q 

i 



Q 



<§• 



1 



WO 00/20885 



PCT/EP99/07474 



3/8 



WO 00/20885 



PCT/EP99/07474 




WO 00/20885 



PCT/EP99/07474 




WO 00/20885 



PCT/EP99/07474 



6/8 




WO 00/20885 PCT/EP99/07474 




WO 00/20885 



8/8 



PCT/EP99/07474 



Reference Reference Reference Reference 
Lines Lines Lines Lines 



B 



\ s\ s\ s\ 



SAD\1 



SAD\2 



\SAD\ 3 \SAD\ 4 
/ 



Reference/ Reference Reference Reference 
Lines/ Lines Lines Lines 




B 



\ / v/ y_/ 

\SAP\ 5 \SAD\ 6 \SAD\ 7 



V 



sy 

FIG. 8 



INTERNATIONAL SEARCH REPORT 



inn onai Application No 

PCT/EP 99/07474 



8. FIELDS SEARCHED 


Minimum documentation searched 

IPC 7 G01S A61B 


(classification system followed by classification symbols) 

G06T 






Documentation searched other tnar 


minimum documentation to the extent that such documents 


are included in the f 


ields searched 



A. CLASSIFICATION OF SUBJECT MATTER 

IPC 7 G01S7/52 



According to international Patent Classification (IPC) or to both national classification and IPC 



Electronic data base consulted during the international search (name of data base and, where practical, search terms used) 



C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category * Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



DE 31 24 655 A (SIEMENS AG) 
5 January 1983 (1983-01-05) 
page 10, line 16 -page 14, line 1; figures 



US 5 359 513 A (KANO AKIKO ET AL) 
25 October 1994 (1994-10-25) 
column 4, line 56 -column 15, line 5; 
figures 1A-1D.11 

US 5 657 402 A (BENDER WALTER R ET AL) 
12 August 1997 (1997-08-12) 
column 13 -column 20; figures 7,8 

US 5 538 004 A (BAMBER JEFFREY C) 
23 July 1996 (1996-07-23) 
column 11 -column 15; figures 



1-4,8-11 

5-7, 
12-15 

1-4,6, 
9-11 



1-15 



1-7, 
13-15 



-/-- 



m 



Further documents are listed In the continuation of box C. 



El 



Patent family members are listed In annex. 



* Special categories of cited documents : 

"A* document defining the general state of the art which is not 

considered to be of particular relevance 
*E" earlier document but published on or after the international 

filing date 

V document which may throw doubts on priority claim(B) or 
which is cited to establish the publication date of another 
citation or other special reason (as specified) 

"O" document referring to an oral disclosure, use, exhibition or 
other means 

"P" document published prior to the international filing date but 
later than the priority date claimed 



T later document published after the international filing date 
or priority date and not in conflict with the application but 
cited to understand the principle or theory underlying the 
invention 

"X" document of particular relevance; the claimed invention 
cannot be considered novel or cannot be considered to 
involve an inventive step when the document is taken alone 

"Y" document of particular relevance; the claimed invention 
cannot be considered to involve an Inventive step when the 
document is combined with one or more other such docu- 
ments, such combination being obvious to a person skilled 
in the art. 

document member of the same patent family 



Date of the actual completion of the international search 



10 January 2000 



Oate of mailing of the international search report 

14/01/2000 



Name and mailing address of the ISA 

European Patent Office. P.B. 5818 Patentlaan 2 
NL -2280 HV RijswIJk 
Tel. 1+31-70) 340-2040, Tx. 31 651 epo nl. 
Fax: (+31-70)340-3016 



Authorized officer 



Devlne, J 



Foim PCT/1SA/2I0 {second sheet) (July 1992) 



page 1 of 2 



INTERNATIONAL SEARCH REPORT 



Inu onai Application No 

PCT/EP 99/07474 



C(Contlnuatlon) DOCUMENTS CONSIDERED TO BE RELEVANT 



Category '• 



Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



US 5 779 641 A (HATFIELD WILLIAM THOMAS 
ET AL) 14 July 1998 (1998-07-14) 
abstract; claims; figures 

ELAO M ET AL: "RESTORATION OF A SINGLE 
SUPERRESOLUTION IMAGE FROM SEVERAL 
BLURRED, NOISY, AND UNDERSAMPLED MEASURED 
IMAGES" 

IEEE TRANSACTIONS ON IMAGE 
PROCESSING, US, IEEE INC. NEW YORK, 
vol. 6, no. 12, page 1646-1658 
XP000724632 
ISSN: 1057-7149 

MOSKALIK A ET AL: "REGISTRATION OF 
THREE-DIMENSIONAL COMPOUND ULTRASOUND 
SCANS OF THE BREAST FOR REFRACTION AND 
MOTION CORRECTION" 

ULTRASOUND IN MEDICINE AND BIOLOGY , US , NEW 
YORK, NY, 

vol. 21, no. 6, page 769-778 XP002060900 

ISSN: 0301-5629 
page 772 -page 773 



1-15 



1-15 



1-15 



Form PCT/ISA/210 (continuation of second snoot) (July 1»02> 



page 2 of 2 



INTERNATIONAL SEARCH REPORT 

.nformotlon on patent family members 



Inte onal Application No 

PCT/EP 99/07474 



Patent document 
cited in search report 


Publication 
date 


Patent family 
member(s) 


Publication 
date 


DE 3124655 


A 


05-01-1983 


JP 


58005649 


A 


13-01-1983 


US 5359513 


A 


25-10-1994 


JP 


7037074 


A 


07-02-1995 



US 5657402 


A 


12-08-1997 


JP 


8503088 


T 


02-04-1996 








WO 


9410653 


A 


11-05-1994 








US 


5920657 


A 


06-07-1999 








JP 


5304675 


A 


16-11-1993 



US 5538004 A 23-07-1996 NONE 



US 5779641 A 14-07-1998 DE 19819831 A 19-11-1998 

JP 11028211 A 02-02-1999 



Form PCT/ISA/210 (patent family annex) (July 1 992) 



This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

□ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 
M FADED TEXT OR DRAWING 
^BLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 
Q / REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



